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Abstract 

A mapping strategy for thinldng critlcany about expository text was used with six high school students 
who had difficulties in reading comprehension: Four were sophomores in a remedial reading 
program^ and two were juniors in a special education^program for the rnildly retarded. Subjects read 
passages from an_unfamiliar textbook on U. S. government history. The forrriat was mddel-lead-test; 
i.e., the teacher first modeled the strategy, then led the student in completing the map, and finally 
allowed the student to complete the map independently. The components of the critical thinking 
map were: main idea of the passage, majoj^ points that support the main idea, other viewpoints, 
reader's cbnclusioh, arid relevance to a contemporary situation. All subjects improved substantially in 
daily comprehension of lessons. Remedial reading students showed better maintained imprbvemerit 
over time. All subjects improved comprehension of passages from a different social studies text 
indicating abili^ to generalize to similar content. Four students also showed improved generalization 
to reading of a_differeht content area All subjects improved in a standardized test of reading 
vocabulary and five of the six improved on a test of reading comprehension. All but one subject 
demonstrated improved generalization to nonverbal thinking tasks and all improved for verbal 
thinking. 
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A eriticaLThinkihg Map to Improve Content 
Area Comprehehsibh of Poor Readers 

Reading researchers and educators have been cautioned not to place the cart before the horse when 
developing techriijques for improving reading cbmprehension of content areas (Vacca & Vacca, 1983). 
This reversed order has resulted in the development of teaching methodologies prior to developing 
theories about how the process of how efficient reading occurs in good readers. It is likely that 
techniques which are exemplifications of theories are those that prove to be most effective, as well as 
being those, that contribute most to our own understanding of how humans process written 
information. 

Reading and Thinking 

An example of the preferred order, thebiy preceding practice, can be seen in recent advances made in 
reading comprehension research during the past 15 years. Particularly germane are two theories 
which have examined the relationship between reading and thinking: schema theory and 
metacognitive theory. 

Schenia theory. Schema theorists have made a major contribution to our understanding of how 
thlnicing impacts upon the reading process .O.e., Anderson, 1977-78; Anderson, Spiro, & Anderson, 
1978; Rumelhart, 1981; Spiro, Bruce, & Btewcv, 1980). According to this theory, the correspondence 
between_a reader's underlying knowledge strurtures (schemata) and textual material determines the 
extent of comprehensidn. The criticai thinking map used in this study contains various 
subcomponents related to three areas icTeritified by Spiro (1980) as being pertinent to instruction 
which b^mlds knowledge structures^ They include (a) developing an awareness of the nature and 
limitations of existing schemata, (b) learning to use schemata efBciently and effectively within these 
limitations, and (c) recognizing the relationship between existing schemata and the reading material: 

Metacognitive theory. Some of the most noteworthy advances in understanding comprehension have 
been made by theoreticians interested in metacopitibri. Flavell (1981) describes metacognltlon as a 
knowledge which regulates any aspect of any cognitive endeavor. Baker and Brown (1984) define 
metacognit[on as reference to one's understanding of any cognitive prcK:ess, using skills which Involve 
planning^ checking, and evaluating as one reads. It is the process that allows us to think about what 
we are reading as we read. Collins and Smith (1982) discussed two different sets of processing skiils 
that have emerged from re^arch on metacognition. The first are comprehension monitoring skills, 
which involve the reader's monitoring of o for cbmprehehsipri failures^ and taking 

remediaLaction when falure occurs^ Development of these skills in poor readers is the focus of the 
work of Brown and Pallncsar (i.e.. Brown & Palincsar, in press; Palincsar & Brown, 1984). 

In contrast, the second type of sldlls have to do with hypothesis formation arid evdTudtidn. These 
involve using clues in the text to generate, eviluate, and revise hypotheses about current and ftiture 
events in the text. The latter set of sldlls are more characteristic of the type of instruction used in this 
study. A disfincfion is that Instead of relying solely on textual clues, a critical thinking map (see 
Figure 1) is uped to provide the reader with a set of stimuli to use for generation, evaluation, and 
revision of h> i^otheses. 

Baker arid Brown (1984, p. 354) have Idenfified several metacognitive skills involved in reading that 
are related to components of this critical thinking map. These skills are: 

1) clarify the purposes (understanding both explicit and implicit task 
demands). 

2) identify the Important aspects of a message. 
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3) focus attention on the major content rather than trivii 

4) monitor ongoing activities to determine whether comprehension is 
occurring. 

5) engage in seif-questibriing to determine whether goals arc being 
achieved. 

6) take corrective actiori when failures in comprehension are detected; 
The eritical Thinking Map 

The critical thinking inap u^^^ meets these standards in several ways (see Figure i). The 

map contains five componente which tl?e reader must complete either during or after reading a 
passage in a social studies text. They include: (a) the important events, points, or steps which lead to 
the main idea^esson, (b) th^ lesson itself, (c) the other viewpoints and opinions of the 

reader, (d) the reader's conc[usion upon reading the passage, and (e) any relevancy the reader sees 
between what was read in^the passage and contemporary situations. Following are more explicit 
explanations of the five components. 



[Insert Figure 1 about here.] 

Impbitant events. TO^^ (events, points, or steps) which lead to the 

main interit or main idea of the lesson presented in the text. They are stated explicitly in the text and 
may be presented in several ways. One example is when important points are presented in a 
compare/contrast fashion, in this case the map user would divide the map component in half, listing 
the points for each of the two sides of the issue. Another example is to present the points in a 
pro/con display, listing the positive mid negative attributes of the issue. A third map use example is to 
list cause and/or temporal points, indicating the influence of each point upon successive points by 
using connecting, causal arrows to identify the important aspects of a message. The second 
metacbgriitive skill listed above by Brown is met by this component. 

Main idea/lesson. This is the most important message conveyed by the author and can be textually 
explicit, textually implick, or scriptally impHcit (see Pearson & Johnson, 1978), or any combination of 
the three. In some cases there may be more than one main idea or lesson presented in the passage. 
These may go well beyond what is in the text itself; reflecting the overall attitude of the author toward 
the uiformation presented in the text. Brown's suggested first and third metacognitive skills, 
clarifying purpose and focusing attention on major content, speak to this component of the critical 
thinking map. 



Other vieHpointsAopihlbris. These responses reSecHhe reader's own viewpoints and opinions about 
what has been read. This is the background information and world knowledge the reader already 
possesses prior to reading the passage. Aside from asidng readers about their opinions of what they 
read, this information could be elicited by asking which other information or opinions may not have 
been stated by the author, asking how else the reader coujd think about this information, or by 
asking readers what else they know about the lesson topic that might affect their overall 
understanding or conclusions. 

This component is related to the fourth skill in Brown^s list^ monitoring ongoing activities to 
determine whether cpmpreherision is occurring, by thinking about what one knows as one reads. 
Baker and Brown (1984) refe_r_ to this as one of several types of comprehension failure and one 
defined almost 20 years ago. The failure oxxurs because the reader inteiprets material in a manner 
desired by the author, rather than considering an alternative interpretation, and is thus deluded to a 
certain degree (Eller, 1967). 
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Metacognitive ski'Is five and Jix. as listed by Brown, are utilized by the reader as ail of the above iiiap 
components are filled in. These involve checking with oneself to determine whether the tasks 
reqaireri by the components are being met, and making changes and corrections when failures to 
Comprehend are detected. 

Readers*^ conclusions. I Ki, content of this response comes from the integration of what readers have 
read with what they already know. Based upon this integration, readers must decide if the author's 
conclusions are valid or invalid. Users of the critical thinking map express reasons to support their 
choice oy stating final conclusions about the passage, based on the c-mbined knowledge from all of 
the preceding map components. 

B^elevance to today. Tie task here is to require the reader to engage in a final form of integrative 
thought, making comparisons between the historical lesson they read about and thinking about what 
modem people can learn from past events. The intent is to assist the reader in understanding how we 
can live better today by examining how people lived in the past. The reader is asked to draw these 
compansOTS so that as a people we might make better choices for living by our understanding of past 
events. The reader's ability to do this requires retrieval of the previously collected information, as 
well as of previously-stored world and experiential information. These two classes of remembered 
events must be integrated resclting in an original and ^thesized solution to the question of 
relevariQ'. 

Finally, the critical thinking m^ helps to correct for andiher type of comprehension failure, also 
discussed by Baker and Brown (1984); This failure occurs When readers have the appropriate 
schemata, but the author has not provided enough clues to suggest use of the relevant schemata. In 
this case the author is at fault for not conveying ideas clearly enough, yet the map provides the 
structure for aiding readers in a search for those clues. 

In summary, the critical thinking map stimulates a kind of hypothesis formation skill that allows the 
reader to make interpretations of the text as opposed to making predictions about what wil! happen 
next. AS recommended by Gollins and Smjth (1982) the focus is on the process of comprehension 
rather than on thejroduct. The method employed in this study begins with teacher modeling of the 
desired process. This modeling phase, as advocated by Collins, et al., is essentially a slow motion 
picture of how comprehension takes place in a sophisticated reader. Then using a model-lead-test 
paradigm (Englemann & Gamine, 1982; ido[, iapress; Idol & Croll, in press; Idol-Maestas, 1985), the 
teacher gradually shifts the responsibility of hypothesis fbrmafion to the shoulders of the reader. This 
shift IS accomplished by following teacher modeling with a teacher-assistance phase ilead), and then 
finally requiring the reader to perform independently (Test). 

It only stands to reason that these theories about reading and thinking should form the foundation 
for development of methods to prepare students to read content area materials. But, the most 
important test of relevancy is whether or not these techniques can be Used to alter the 
comprehension behavior of students who appear to understand little of what they read. This 
effectiveness can be demonstrated if certain conditions prevail: (a) the reader is able to employ the 
strategy, (b) the immediate reading comprehension of the reader is improved, (c) the reader 
demonstrates an eVer-increasing ability to use a strategr without teacher assistance, (d) the reader 
continues to read with improved understanding after the artificiality of the instructional technique 
has been removed, and (e) some generalizability ofjhe improvement can be found in reading content 
not previously used for instruction, in contc"* relatively different from that used for instruction, and 
in other applications of the thinking process itself, as seen in some standardized tests of nonverbal 
and verbal thinking abilities. 
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Method 

Subjects 

The subjects were six high school students whose teachers identified them as having difficulty with 
reading comprehension, yet who were viewed as having adequate word recognition skills For 
puposes of this study, this will be used as the definition for poor readers. Refer to Table 1 for a 
summarization of the entry levels for both vocabulaiy and comprehension as measured by the 
Stanford Diagnostic Reading Test (SDRT). These test data were in the students' permanent records, 
had been administered a^the end of the previous school year, and were Used by the teachers as an aid 
in selecting suitable students for the study; teacher judgment was the final selective factor. Table 1 
also contains a measure of how poorly the students were comprehending prior to the study. This is a 
discrepancy score reflecting the years-months between the students' grade level prior to the study and 
the reading comprehension score on the SDRT. Four subjects were only adequately comprehending 
materials three or more years below grade level. Hie remaining two students showed differences of 
2.8 and 1.2 years below grade level. 

T^o students were sophomores and four \.^re juniors^ four were enrolled in a remedial reading 
program and two in a self<;bntained special education program^for educable mentally handicapped 
students. All six students attended the same high school in a medium-sized, midwestem city The 
remedial reading students were two white females aged 16, one black male aged 16, and one white 
male aged 15. All four of these students were of average intelligence^ The special education students 
were one black female, and one white female, both aged 16. These students had intelligence scores of 
59 and 72 (respectively) on the Weschler Intelligence Scale for Children-Revised. In total, there were 
four females and two males, four white and two black students. 

[Insert Table 1 about here.] 

Teachers 

The teachers were two white, female, graduate level research assistants, both of whom were 
experienced classroom teachers. 

Procedures 

Research design. The experimental design was an AB/maintenance, single-subject design with 
multiple basehne across students. The iHterventiori (B) phase had multiple phases embedded within, 
as a means of shaping an independent level of response. The students were randomly assigned to 
baselines ranging in length from four to ten days and stratified by assignment to either remedial 
reading or ^cii education prograffis. In this desish, subjects serve as their own control via the 
extended baseline acros subjects where each subject's baseline performance is ej^ected to be 
depressed until initiation of the intervention (Baer, Wolf^ & Risley, 1968; Hersen & Barjow, 1977; 
Kazdin, 1982). In this stuc'y, the second baseline serves as a maintenance phase, during which 
improved student performance would be expected to maintain or stabilize after inteivention removal; 
this would be an indication of long-term effects of the intervention (Hersen & Barlow, 1977; kazdin, 
1982). 

Instrcction. A modej-lead-test instructional paradigm was used to shape learner response to an 
independent level of performance. Following baseline conditions, the teacher modeled nx of the 
cntical thinking map^ then tead the student in completing the map, and finally required the student to 
complete the map independently (rest). These procedures are described in more detail as follows; 
For phase changes from test to lead to maintenance phases, criterial levels of mastery were set to 
determine when to make a shift in phases. 
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Baseline conditions (A). During baseline cbhditiSns, daily percent of correct comprehensiori 
(primary dependent measure) was monitored and continued throughout aii phases as a means of 
comparing phases. On the first day of baseline, the teacher explained the meaning of the questions to 
be asked after reading. These questions (see Figure 2) were the same as the component parts of the 
critical thinking map. The teacher explanations were b^d on the definitions for each mai? 
component which appear in ah earlier section. (Teachers verbalized this information to the principal 
investigator prior to ejjilaining it to the students.) Sn the first day and subsequent days students 
were shown the parts of the social studies lessons to be read and asked to determine hdw many pages 
were to be read. They were reminded that they would answer written questions about what they had 
read when they V ere finished reading the assignment silently. Time spent reading silently was 
recorded by the teacher. Students then answered the five questions being told to construct the best 
possible answers without referring back to the lesson. Upon completion, a lOO-word timed sample of 
the students' oral reading, randomly selected fi-om the lesson, was collected as a means of monitoring 
accuracy and rate of reading. 

[Insert Figure 2 about here.] 

Intervention conditions (B). During this phase the teacher modeled the responses she desired when 
using the critical thinking map (see Figure 1). The teacher orally noted the number of pages to be 
read and then read the leMon aloud, talking about map components as she identified answers to 
them in the lesson, aid filling in this information on the map. After completion of reading, she orally 
read the map components, checking for response accuraQr and adding more information when 
necessary. Then the student silentjy read the questions arid wrote written responses to the questions, 
as described for baselirie conditions. Finally, the timed sample was collected. This modeling phase 
was continued for at least three d^s unless performarice Was at or above a criterion of 86% correct 
responses to the_generic questions. An exception was subject C; this was the first subject to receive 
the treatment. Experimentation was allowed to determine if students would reach the 80% mastery 
cntenon if the number of days in this phase were extended. After 10 days, subject C had not yet 
reached cntenon but was gradually improving. As can be seen with all of the remaining students 
(Figures 3 & 4), extended length of the model phase was not important, as the -tudents were only 
passively engaged, observing the teacher using the map. Rapid improvements were seen once the 
lead phase descnbed below was begun with students being more actively engaged. 

[Insert Figures 3 & 4 about here.] 

During the fefli/ phase, baseline conditions were followed with the student silently reading the lesson 
ITie student arid teacher then examined the lesson together, looking for answers to map components. 
The teacher encouraged student initiations, responding only if the student was unable to locate or 
uifer a con-ect response. The student wrote all responses on the map. Baseline conditions were 
followed for responding to questions and obtaining the timed sample. Task mastery was defined bv 
setting a criterion level of 75% con-ect responses to comprehension questions for two out of three 
consecutive days. 

In the test phpe, students were told to read silently and then to construct the niap without teacher 
assistance. If the student did, in fact, request teacher assistance, the teacher provided help by 
reverting to the conditions followed during the lead phase: An exception to this error correction 
procedure was that teachers never pro\ided assistance for these map components: Other Viewpoints, 
Reader's Conclusions, and Relevancy. After lesson reading and map completion, students wrote' 
written responses to the comprehension questions. Note that students B and E never received the 
rest phase; by the time they had completed^the lead phase, there was insufficient time to implement 
the test phase, and these students were moved to the maintenance phase. The masteiy criteria 
necessary to change phases was a 75% connect response to the comprehension questions for five of six 
days. 
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Maintenance conditions, immediately following the test phase, baseline conditions were foiiowed as 
a means of demonstrating a maintained improvement over time. Essentially, students read lessons 
and answered the questions without using the critical thinking map. 

Materials 

iTie lessons that formed the base fqi: th(yri were taken from a social studies text written 

about American history (Fenton, 1975). The passages were used in the order in which they appeared 
in the text because they followed a logical and temporal sequence. 

Dependent Measures 

Five tjpes of dependent measures were monitored in this study. The first was percentage of correct 
responses to five g-neric questions (see Figure 2). These questions were asked after completion of 
each social studies lesson. 

The second and third t^es of dependent measures were attempts to measure generalization of 
improved reading comprehension. One was a measure ^ near generalization for which students read 
lessons from a different social studies series containing similar passage constructions (Relcosh, 1981). 
The second was a measure ofjar^enerafeafton for Which students read lessons from a very different 
^e of content area. The text was required in a driver's education class taken by nearly all students 
in the students' high school (American Automobile Association, 1970). 

Both generalization tests were administered before beginning baseline conditions (pretest) and after 
finishing the maintenance phase (post-test). Six sample lessons Were randomly selected from each of 
the two texts (social studies and driver's education). Three lessons Were used for pretests and three 
for post-tests. The same generic questions (Figure 2) were used for these generalization tests 
Measures oi accuracy and speed of oral reading of a time, 100-word sample of each lesson were also 
obtained. The latter measures were taken to ensure that the students Could read the words in the 
lesson (90% or better) well enough to validate collection of a measure of reading comprehension. 

The fourth tjpe of dependent measure was performance on several standardized reading tests. The 
tests included the Vocabulary and comprehenspn subtests of both the Nelson Reading Skills Test 
(Hanna, SchelL& Schreiner, 1977) and the Stanford Achievement Test (Gardner, Rudmari, Karlsen. 
& Merwin, 1983). A measure of reading rate was also collected from the Nelson Reading Skills Test* 

The fifth type of dependenimeasure was a series of subtests from one of two standardized tests of 
reading and intelligence. These subtests were selected because they were thought to be possible 
measures of generalization of nonverbal and verbal thinking abilities. The nonverbal abili^ measures 
were the Ana^sis/^ntHssis and Concept Formation subtests of the Woodcock-JohnSoh P^cho- 
Educational Battery. The verbal ability measures were the Analogies subtest of the Woodcock 
Reading Mastery Test and the Similarities subtest of the Weschler Intelligence Scales for Children- 
revised. 

The finca set of dependent iTleasures was tw6 questions designed to record the students' own 
strategies for understanding and remembering what they had read; For a test of u.iderstanding 
students were asked, "What do ycu do to help yourself understand what you read?" TTie question for 
testing remembering was,. "How do you help yourself remember what you read?" Both questions 
were asked of all students before, the baseline phase began and after the maintenance ended. 
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Reliability Procedures and Results 

All instrnctionai procedures were practiced, in simulation by the teachers prior to teaching the 
stnderits. These simulatidns were observed by the principal investigator until teaching procedures 
were metered. TTien, teachers followed a checklist to make certain they observed the instructionai 
procedures in a precise sequence. Teachers occasionally observed each other while teaching to 
ensure that these procedures remained constant. 

All standardized tests and subtests were scored independently by two persons, with 160% inter-rater 
agreement. 

The responses to the generic questions used in daily instruction and for both near- and far- 
generalization measures were scored in their entirety by each of two independent scorers. Responses 
resuIHng in discrepant results were scored a third time by the principal investigator. This person also 
mdependently scored 26% of all responses obtained from daily instruction and all measures offar- 
and near-generalization. ITie scoring criteria appear in Figure 5. Inter-rater reliability coefficients 
between the first two raters (Peareon r) were calculated from a totaJ of 232 responses. Agreement 
was high and always statistically significant (p = .001) across all five question types: important events, 
points or steps (r = .93), main idea/lesson (r = .98), other viewpoints/opinions (r = .98), reader's 
conclusions (r = .91), relevance to today (r = .91). 

[Insert Figure 5 about here.] 

Results 

Generic Questions 

AH six students showed plositive shifts in their ability to respond to the generic questions, asked after 
reading each lesson. The two special education students were more likely to show a drop in 
maintained behavior when the critical thinidng map was removed. These students both showed 
significant improvement in reading comprehension; however, student B had the most difficult time 
learning to use this strategy (Figure 1). At the end onhe study she was just beginning to complete 
the maps without teacher assistance (lead phase). As expected, the improvements Were more likely to 
regress during the maintenance phase. In contrast. Student A completed the test phase of 
independence; her performance regressed in the first day of maintenance but steadily improved back 
to the mastery level. 

The special education students required more days of instruction (39 and 40 days for students A and 
B) than the remedial reading students who ranged from 27 to 33 d^s of instruction. These days 
included model, lead and test phases. 

Tire most jmpresive improvements were seen in the remedial students; all four were char?,cterized by 
strong and positive shifts in comprehension from baseline to test phases (Figure 3). They maintained 
this mprovement in reading Cbmprehensibn when no longer required to use the critical thinking 
maps. Even Subject E, who was not in the study long enough to reach the test phase, demonstrated 
maintmned miprowment It is interesting to note that both subjects D aid F completed both the 
lead aid test phases in a very brief amount of time (6 to 16 days)^ but performance during the first 
maintenance pha^KS begail to dissipate. Both students were returned to t^st phase, using the maps 
independently. After a longer period of time (9 to 10 days for test phase alone), their comprehension 
showed maintained behaviors Well above criterion mastery. 
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Near- and Far-Geiieraiizatibn 

All six. subjects showed improvement in reading comprehension on the measure of riear- 
geheralizadbn, ranging from 11% to 60% improvement (Table 2, Column 16). The smallest 
imprbVement was shown by Subject E and the greatest by Subject F, both reirledial reading students. 
Four of the six subjects improved on the far-generalization measure of comprehension, reading in the 
driver's education materials. One special education student (Subject B) and one of the remedial 
reading students (Subject D) failed to improve on this measure. 

For both daily reading^and the measures of near- and far-generalization, all subjects continued to 
correctly recognize 90% or more of the words during oral reading. The rates at Which they read 
vaned considerably across Subjects, as was reflected by the pre-/post-median scores for Correct words 
per minute (cwpm) for both near- and far-generalization tests (refer to columns 15 and 18 of 
Table 2). 

[Insert Table 2 about here.] 

Standardized Tests of Reading 

Grade equivalent gain scores on the vocabulary and comprehension subtests of both the Nelson 
Reading SkdHs T^st and the Stanford Achieveinent Test indicated improvement in four of the six 
subjects. (Improved gain scores are those i'l Table 2 that are enclosed in boxes.) Scores were 
considered to be an improvement when the Jain was larger than the number of months the student 
received instruction (see the final Column in Table 2 for these durations of time); All subjects made a 
gam m vocabuJaiy on at least one of the two vocabulary tests, although the gains of Subject C did not 
meet the cnterion for time duration. Five of the sk subjects improved on one of the two tests of 
comprehension. Again, Subject C failed to improve on either test; Subject Cjras not one of the 
slower students and, in fact, showed improved and maintained gains in daily instruction. Five of the 
SK subjects, excluding Subject E, showed large gains in reading speed on the Nelson Reading Skills 
test. 

Generalization of llilnking Abilities 

Four of the six subjects gained in grade equivalent scores on at least one of the two subtests for 
nonverbal tWnking (Table 2, Columns 10 & 11). Subjects E and F, both remedial reading students, 
did not improve in this area. All subjects improved on one of the two verbal st:btests (Table 2 
Columns 12 & 13), with the majority (n=4) doing So oh drawing ana'ogies. 

Students' Ihdtvidiial Strategies 

The majority of these students showed increased Use of the types of strategies they used 
spontaneously to encourage remembering and understanding. Improved quality of responses was 
defined as any indication that the student was aware of the heed to think about the reading, and/or to 
ask oneself questions about the reading. The individual regjbnses are displayed in Table 3, organized 
by pre- and post-responses to each of the two questions. FbUr Students improved the quality of their 
response in describing a comprehension (understanding) Strategy (Students A, D, E, & F). Two 
students (B and C) showed good respon.ses during ihe pretest. F'or memory (remembering) 
strategies, four of the sk students showed improved respbriSeS (Students A, B, E, & F). Again, 
student B showed good initial responses. 



[Insert Table 3 about here.] 
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For_both response types there is considerable variety in the types of strategies students selected, 
eomprehension strategies ranged from improved attehtibri_to text, reading slower, skimming for 
main ideas and remembering to think about what was read. The memory strategies were also varied, 
including self ^que^srioning, inferring meaning of unfamiliar words, remembering to think about the 
lesson, and sbwing down the reading process. An interesting phenomenon is that the one student 
who cohsistently offered good pretest strategies was one of the poor comprehenders in the group, 
raising questions about whether she was actually applying the strategies she described, especially at 
the beginning of the study: 

Discussion 

Educators concerned vwth teaching read have been much more likely to focus on 

teaching word recognition, and much less likely to place emphasis on teachins students to think as 
they read. It's almost ^ if teachers_ have believed that, once the physical act of decoding has 
occurred, the encoding process (processing of received infofmatibn) will occur naturally. The 
findings of this study lend support^ that reading comprehension can be greatly 

improved by teaching students to impose a structure upon the text, especially if the structure provides 
a basic framework for readers' tliinking processes as they read. 

In this study there was some induration that improvement will occur more quickly and last longer with 
remedial reading students than wijh special education students, althbuth all students showed 
improvement on daily comprehension when using the critical thinking map. These differences may be 
due to differences in intellectual abiHty, although_ a more indepth ejqjloration of differential 
performance is needed. Researchers interested in studying the relationship between thinking and 
reading comprehension need to identify the particular aspects of intelligence that promote good 
understanding. 



There was also a tendency for the less ab[e students to be more dependent upon teacher assistance, 
as shown by the longer practice period needed to reach a level of independent learnjng. Similar 
findings emerged in an earlier study (id ol-Maestas, 1985), in which students classified as being 
learning-disabled and demonstrating poor comprehension showed good comprehension 
imprbvement with teacher assistance, but decreased comprehension without the teacher. Although 
the methods were different in the first study, which focused more on teaching prereading activities, 
the same general pattern was observed in the present study. In contrast, in anbther study (Idol & 
Crbll, in press), improved comprehension maintained without teacher assistance wjth a younger 
grbup of learning-disabled students. The methods were more similar tb thbse Used in the present 
study, in that a type of mapping strategy was used to teach_students about the general structure of 
narrative stories. A difference was that the two studies showing a dependency on teacher assistance 
for slower students also required the students to rely more upon their own thbughts, while the 
contrasdng study required them only to search for text information (explicit and implicit). It may be 
that the more the_ task requires independent thinking, the more the slower learner will falter; this 
observation may form a base for development of a distinction between intellectual differences bf 
remedial reading students and those of special education students. 

However, in spite bf possible differences in intellectual ability,^! of the students showed some ability 
to generalize the improved cojnprehensiori to reading of unfamiliar and different passages. All 
students showed this generalizabili^ of response when reading in a different social studies series; the 
degree of iinprbvemerit ranged greatly (11% to 6e%)with no consistent pattern to differentiate 
special educatibn from remedial reading students. Four of the six students also improved their 
understanding bf a different type of content area reading (a driver's education text); r.gain with nb 
distinction between the two classes of students, it is likely that student gains may have been 
influenced by their high level of motivation to understand the driver's education text. 
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CJi the more^obal measares of generaiizatib arid ribriverbal subtests of standardi2ed tests) 

alj students improved on at least one of two verbal tests arid four of the six students improved on oiie' 
of twc_ nonverbal tests. Most also showed refiriemerit .arid improvement of personal responses to 
strate^es they used for thinldng and remembering On staridardized reading tests, all students 
showed gams m vocabulary and all but one gained in cbmprehensidri. 

Abili^ to generalize and transfer learning across situations is certainly a tvBe 6f intelliKence 
importantly related to reading ability: These findings would seem to indicate that although slower 
students are more likely to depend on teacher assistance, both slower and more able students can be 
expected to transfer some learning to new situations. Future research in this area must be conducted 
to examme more closely, possible intellectual differences across classes of readers with larger samples 
pf subjects.^ For instance^ are there some dimensions of intelligence, such as independence in 
thinking^d activating schemata, that are poorer in slower students arid likely to exclude them from 
reading with the nch understanding that schema theorists expect should occur in good readers? To 
date, our findings suggest that given direct and carefully shaped instruction, comprehension can be 
improved and transfer can be expected. The relationship between certairi facets of intelligence and 
certain comprehension strategies may be the reffion for the success of some strategies over others. 
Apparently the cntical thinking map was helpful in leading students through a series of steps resultirig 
in the formulation of a set of logical conclusions. Conclusions were based upon a merger of new text 
information^with prior knowledge, mediated by the reader's own ability to ^thesize. and resulted in 
a tinal conclusion applied to contemporary situations. The next step in this line of research is to 
examine ways to improve the independent thinking that occurs during ^thesis iri slower students, as 
a means of reducing teachiinrdependence. 

Application of Research to Practice 

For teachers interested in teaching their students to use critical thinking maps, the following steps 
may be followed: 

Step i: Have the studerit read several lessons silently, checking comprehension of each lesson by 
requinngjhe student to answer the five generic questions in Figure 2. after reading the 
lesson. Take a 100-word timed sample of the student's oral reading from each lesson to 
make certain the reading level of the lesson is not too difficult. (This oral reading sampling 
can be done periodically thrbughbut Steps 3 to 10.) 

Step 2: Make a decision based bri the cbmprehension data ^Stained in Step 1 as tb whether br not 
the^student needs to learn tb use a critical thinking map. (Continue to haVe the studerit plot 
comprehension data thrbughbut all of the subsequent steps if the decisibri is tb teach map 
usage.) *^ 

Step 3: Show the critical thinkirig map tb the student arid explain what is meant by each bf the map 
components. (Refer tb ari earlier section of this article for definitions of each cbmpbrient.) 

Step 4: For two lessons shbw mddel^ the student how to use the critical thinking map by (a) orally 
noting the number of pages to be read in the lesson, (b) reading the lesson albud 
interruptingyourself as answers to map components are encountered in the text, (c) fillirig iri 
map components as answers are encountered, and (d) after the lesson is completely read 
orally re-readmg the coriterits bf the map components, checking for accuracy and adding 
more necessary informatibri. 

Step 5: Instruct the student tb read a lessbri silently^ Then, with the itudent. re-examine (Tead) the 
lesson looking for answers tb niap cbriipbnents (Steps 4b and 4c above). Then, have the 
student complete Step 4d, abbve, bfferirig assistance wheri needed. 
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Step 6: Instruct the student to give you the completed critical tHnfcirig map; Then, give the student 
the generic questions (Figure 2) to answer with written responses, to then be turned in to 
you for cdnrectibh. 

Step 7: Return the teacher-cbfrected critical thinking map and responses to generic comprehension 
questions. Discuss with the student any discrepancies between incorrect comprehension 
responses and correct map information. Have the student rewrite incorrect comprehension 
responses. 

Step 8: Gradually require the student to fill in the map components with less assistance from you 
(test). 

Step 9: When comprehension responses consistently remain above 89% correct with little or no 
ass|stfflice from you, discontinue Use of the critical thinking map, having the student continue 
as described in Step 1. 

Step lezQffer the stodenta new chaUeng by discontinuing use of generic questions; instead, require 
the student b_sj[ently read the passa^^ and write a paragraph which pertains to each of the 
components of the critical thinking map. 

Of course, the above sequence of instruction can be modified for group instruction by completing 
Steps 3 to 5 with the group at large, requiring the students to read silently and demonstrating and 
asking questions of the group at large. Retcr to Idol (in press) for an example of how instruction of a 
similar mapping strategy was adapted for group instruction. 
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SurnSaiy of Descriptive Data for the Six Subjects 



l>ject 


Age 


Grade 


Program 


Race 


Entry level/SDRT^ 
Vocabulary Comprehension 


L/lUwivntC 

Score'' 


A 


16 


11 


vSpecial Education 


Black 


no score 3.0 


8.0 












available 




B 


i6 


11 


Special Education 


White 


3.8 4.6 


6.4 


C 


16 


ii 


Remedial Reading 


Black 


7:i 7.7 


33 


D 


15 


ii) 


Remedial Reading 


White 


9:1 8.8 


1.2 


E 


i6 


li 


Remedial Reading 


White 


7.9 7.6 


3.4 


F 


16 


ii) 


Remedial Reading 


White 


6:7 12 


7.8 



Scores reflect grade equivalents. 

Scoresieflect differences in years-months between students' grade level at the beginning of the study and the reading comprehension i 
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Fable 2 

Summary of Seceiidaiy Dependent Measures Across Sui>jecis 



Enti7 ixvcI^DRT Standardized Tests of Reading 



Standardized Tests of Generalization 



m NRST NRST SAT SAT Woodcocic 



Woodcock 



Woodcock'' 



Grade Vocab' Comp (Vocab) (Coihr) (Rate) (Vocab) (Comp) (Anal/Syn) (Concept Form) (Analogies) 



11 



3.0 +0.2 -0.8 +2.6 



+1.0 



+2.3 



+3.8 



MM 



11 3.8 4.6 



+4.8^ 



^1.1 



+3.6 



+0.3 



+1.0 



0.0 



-1.0 



11 7:i 7.7 +0,2 ^.7 



^5.7 



+0.4 -.04 



+2.0 



10 9.1 8.8 



+0.7 



+1.3 



+1.0 



+1.0 



+i;a 



11 7.9 7.6 ^).3 



-0.4 -0.4 +0.7 



-3.0 



0.0 



-^G.5 



10 6.7 7,2 



42i 



+5.0 



+2.2 



-.06 0.0 
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Table2(eohtihued) 



Pre 



Post 97% 



97% 

m 

96% 



m 

96% 



Near Gericralization^ 
Rate 



62c wpni 
87 c^vpm 

S7cwDm 
Mcwpm 

55 cwptn 
75 jwpm 

44fcwpm 
94 cwpm 



?9twptn 
91 cwpm 

55 cwpni 
50 cwpm 



Comp 



Accoracy 



Far-Gcncralization 
Rate 



Comp 





m. 


108 cwpm 




m 


97% 


101 cwpm 


30% 






101 cwpm 




40% 


96% 


96cwijiri 


15% 


m 


m. 


68 cwpm 




45% 


99% 


91 cwpm 


55% 


M 


100% 


173 cwpm 




30% 


100% 


159 cwpm 


50% 




m 


99 cwpm 


tm 


15% 


95% 


106 cwpm 


Wo 


m 


94^ 


IDS cwpiii 




85% 


97% 


93 cwpm 


mo 



Data reflect changes in grade equivalent scores (^ears, months) for columns 3 to 12. 
''Data reflect raw score changes for column 13. 

Data reflect median, pre-/post scores for columns 14 to 19; 
□ = Grade equivalent gain scores greater than time duration of study. 
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tables 



by Su^ecS^'"^^^^**^ *^ Questions about Understanding and Recalling Strategies Used 



Subjects 



Understanding 
Pre-Respbrises Post-Responses* 



Pre-Responses Post-Responses 



Ask questions; read 
it over. 



Read it over as 
many times as pos- 
sible and think 
about what I have 
read before I put 
anything down. 



Skim through It. 



I inust r e m e m ber what 
I read arid J^Hmk 

^▼^I Hlt> IJLiCjiUJli 

befefe I answer the 
question. 



I reread It. figure Re-read to help me Reread it, ask I would re-read a 

out what questions understand- what myself what was book, then sbmebne 

people might ask, I read; read some- the story about, would ask me what 

like who's the main thing that I can parts of the happened. whfr4s 

character, what the understand. story. the main char aetef 

plot of the stoiy what happenedjn 

^' the story that is so 



important . 



Stop and read i^t Read it again. Think about the Pick out some word I 

again. Read slow. first sentence or don't know, and it 

Remember what I ^hat the story is sticks in my head 

about. because I didn't know 

what it meant. Read 
it again; 



R^readj-^xagraph- Read it more Reread until I Go over it more than 

Wh^at s been said slowly and put my know. Depends on once. Read slowly, 

before might help mjqd to it and m. how interesting Get more sleep the 

me understand attention to what it is, whether I night before, 

better. Ask it says. Go over can keep it in my 

teacher for help. it more than once. head. 



Read between the I go over it again. I try to remember TOnk over what 

lines to figure out Read slower. important parts I just read, 

what I'm reading. about the stdiy. whaf happened 



Say tQ myself that Read it over again Read it slower, or Read it slower 

I don't care if real quicfc skirn skim through it instead of real 

people don't like over it. Try to again. quick. Ask myself 

the way I read. So lox>k for thj? main westiens^beut what 

then I get confi- words in the pas- Tiusfrread. right 

dence and I can do sage. You can after the sentence 

It. I stop, try to tell what they are. is done. 

sdUhd outjn 
syllables. Then if 
that doesn't work* 
I ask the teacher. 



^ Improvements are underlined in the post-responses. 9 Q 
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Figure 1 
Figure 2 
Figure 3 

Figure 4 

Figure 5 



Figure Captions 
A map for critical thinking. 

Generic questions asked for each social studies iessdn. 

Percent of correct responses to generic compr^ questions across phases with 

multiple baselines for two special education students. 

Percent of correct responses to generic comprehension questions across phases with 
multiple baselines for four remedial reading students. 

Scoring criteria for generic comprehension questions. 
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A Map for Critical Thinking 

I mport ant E v ents, Points, or Steps 

j 



Main Idea/Lesson 



Other Viewpoints/dpinions 



Generic Comprehension Questionis 



Lesson Day 

Page - 



i. What is the main idea in this passage? 



What were the important steps that led to the main idea? 



What are some other points of view or missing information about this topic? 



4. What is your own conclusion? 



How is this passage relevant to a modem problem or issue? 
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Figure 2 

P3 
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Scbring Eriteria for Generic Comprehension Questions 



Give a total of 20 possible points, four points possible for each of the following: 
1- Important E vents (Answers stated explicitly in the text.) 
Points 

0 = no response or completely wong 

1 = 1 point, step or event was identified 

2 = 2 points, steps, etc. 

3 = 3 or 4 points 

4 = 5 or more points, etc. 

2- Main Idea/Lesson (Answer stated both explicitly and implicitly in the text.) 
Points 

0 = no response or completely wrong 

1 = 25% of a cdffect answer 

2 = 50% of a correct answer 

3 = 75% of a correct answer 

4 = excellent answer demonstrating full understanding of a passage or lesson 

^' gthe^yiewpoints/Qpinions (Answers are scriptally implicit and based on reader's 
background knowledge.) 

Points 

0 = no response or completely wrong 

1 = no point made but it is inaccuriate 

2 = one pointmade (accurate) 

3 = two points made (accurate) 

4 = three or more points made (accurate) 

Reader's Conciasions (Answers based on reader's ability to retrieve and integrate 
information.) 

Points 

0 = no respojise or completely wrong 

1 = bases conclusions only on own point of view 

2 = bases conclusions only on author's main purpose 

3 = bases conclusions on own viewpoint & author's purposes 

0R 



3 = 



conclusions based on own point of view plus a hew ^thesized thought 
OR 
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3 = conclusions based on author's purpose jglus a new ^thesized thought 

4 = bases conclusions on own viewpoint and author's purpose coupl e d with a new synthesized 

thought 



Figure 5 

PS 



Relevance to Today (Answer? based on reader's ability to retrieve, integrate and apply 
information.) 

Pbir i ts 

0 = no response or completely wron^ 

1 = generally relevant to topic but not really the major iessdn or intent of the reading 

2 = the major intent of the piece is conveyed but the student doesn't add anything new 

3 = the major intent is conveyed coupled with a new i^^nthesized thought 

4 = all of the above (no. 3) are met coupled With excellent quality of expression 



Figure 5 (Continued) 



